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ABSTRACT 

I An interactive graphics system has been Implemented 
for tutorial purposes and for research in man-machine communication 
of structural digraphs* An IMLAC intelligent terminal with ligthpen 
input is used in conjunction with a NOVA minicomputer* Successful 
application in linguistics and engineering problem solving are 
discussed r the latter in detail. (Author/EMH) • 
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AN INTERACTIVE, INTERDISCIPLINARY, ON-LINE 
GRAPHICS SYSTEM FOR PRESENTING AND 
MANIPULATING DIRECTED GRAPHS 

by 

William Beazley , James M. Swanson , and John J . Allan Id 
University of Texas at Austin 

ABSTRACT 

An interactive graphics system has been implemented for tutorial 
purposes and for research in man-machine communication of structural 
digraphs. An IMLAC intelligent terminal with iightpen input is used in 
conjunction with a NOVA minicomputer. Successful applications in 
linguistics and engineering problem solving will be discussed, the latter 
one in detail . 
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AN INTERACTIVE, INTERDISCIPLINARY, ON-LINE GRAPHICS SYSTEM 
FOR PRESENTING AND MANIPULATING DIRECTING GRAPHS 

An Interactive graphics system has been implemented in a classroom 
and laboratory environment for tutorial purposes and for research in 
man-machine communication of structural digraphs. The approach arises 
out of the need to measure human specification of structure among options 
that are more complex than his sequential communicating activities\ 
The measurement of these structural messages is aided considerably 
by viewing them as directed graphs, allowing the application of a large 
body of developed theory. The detection of these directed graphs is 
straightforward and the evaluation of a particular structure for the satisfac- 
tion of particular rules or the determination of equivalence to a desired 
answer may be then considered a graph isomorphism problem. 

For example, if a set of possible steps that a subject might take in the 
solution of a problem is presented as possible nodes for a graph, then how 
the subject selects and connects those nodes into a graph of a solution is an 
Indicator of how the subject sees structure in the problem and its solution. 
Alternatively, in academic subjects where structure is well defined, (I.e., 
transformational grammar) the learning of this structure can be based on 
detecting and measurement of student-created graphs. In these examples, 
the order in which the steps are actually performed provides useful infor- 
mation to evaluate understanding of a problem. 



Using a NOVA minicomputer and an IMLAC interactive graphics 
terminal with iightpen input, routines have been developed which permit 
the creation and editing of directed graphs as displayed on an intelligent 
graphics terminal. The prime responsibility of the NOVA minicomputer 
in this system is updating an adjacency matrix containing Information 
about the nature of the digraph nodes and their connectedness, and 
the issuing of drawing instructions to the IMLAC terminal . The prime 
responsibilities of the IMLAC are maintenance of the display and detection 
of Iightpen commands, A routine that checks a subject-created graph 
against a desired graph makes possible feedback in a learning task. 

The content-independent nature of graph theory makes the concept of 
such a system highly transferrable among disciplines. It is now being used 
in teaching information structure afi^problem solving strategies in Engineering 
Design, and transformational grammar in Linguistics. 

V 

A third area of application concerns research on presentation of non- 
linguistic data (spatial information on graphics displays) and the effect of 
non-linguistic response modes (light pen input in graphics systems) . The 
system is also being considered for other applications. 

This particular type of computer graphics system, with its unusual 
capability for structural communication, detection, and measurement, allows 
the expansion of human research into complex communication problems. 



In order to detect and to measure the man-machine communication of 
structure, a system of programs has been developed in. Data General Extended 
BASIC. In this paper the parent system, the system for manipulating directed 
graphs, and the use of this system as applied to engineering design will be 
discussed. 

Th e Parent NOVA-IMLAC CBERT BASIC Interactive Graphics System . 

The host computer system on which the routines of interest were developed 
has a unique set of advantages and disadvantages in the experimental- 
educational environment. The central theme of the NOVA-IMLAC system 
Is the use of an intelligent, vector-capable, interactive graphics terminal 
as an extremely sensitive interface to a relatively inexpensive minicomputer- 
disk configuration running Extended BASIC. 

This results in a master-slave relation between the NOVA minicomputer 
and the IMLAC graphics terminal in which the NOVA bears the burden of 
data manipulation. A heavy emphasis on data manipulation in the IMLAC 
terminal would hav^ decreased the chances of transferring the routines to 
another. system at a later date. As the amount of data manipulation at the 
intelligent terminal increases, the need for a graphics-oriented specialized 
configuration increases. As a result, the probability of adapting the 
developed software for another system would decrease. 

. Another advantage of the C-BE NOVA/IMLAC System is that the NOVA 
minicomputer communicates with the IMLAC terminals through BASIC CALLS 
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to machine language subroutines leaving BASIC unchanged in syntax. 
The use of the developed software for the IMLAC requires, then, only 
the writing of the interface subroutines at a particular site. Also, during 
development, the software efforts for the NOVA and the IMLAC were 
begun and continued semi-^independently with a minimum of revision 
when the combined parent system became operational. 

The LOCOS executive is the resident software for the IMLAC graphics 
minicomputer. It was designed and written to take full advantage of 
the long-vector capability, lightpen, and push-down subroutine stack _ 
features of the IMLAC minicomputer. LOGOS {see Speaker, 1973) (Level- 
Oriented Graphics Operating System) permits the multiple use of a single 
set of drawing instructions, and, as a result, a single graphical item 
(such as a circle) can appear hundreds of times on the graphics screen 
by using LOCOS subroutine calls. In addition, each of these graph item 
appearances can be made to return a unique pair of parameters when 
detected by the lightpen. 

This lightpen capability is not limited just to graphical items. Also 
displayed letters or words (verbal displays composed of user-definable 
characters) can be sensitive to detection by the lightpen and return a pair 
of values . 

A tracking cross can be positioned on the screen, and the raster values 
of the X-Y location can be requested allowing graphical data entry to a 
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limited degree. This is entirely adequate where a point in space is to be 
communicated, or for similar tasks. 

The result is a flexible interactive graphic display capability in a 
resident, but easily interfaced, executive. In experimental or educational 
tasks, a subject's responses can take the form of a character, a word, a 
sentence, a point, a line, an arc, or any arbitrary composite of drawing 
instructions. This is al! in addition to plotting and alpha-numeric display 
and editing capabilities. 

.In summary, the C-BE NOVA/IMLAC/LOGOS interactive graphics 
system is designed to minimize the hardware-dependent aspects of graphics 
interaction while maximizing the graphics interface capabilities and 
sensitivity. It represents a favorable combination of flexibility, transfer- 
ability, and cost. 

The System for Creating and Manipulating Directed Graphs . 

/ 

An assumption is made that activities specific to engineering design are 
the specification of partitions on options (possible parameters, designs, 
calculations, etc.), and the specification of a topology on those options 
(layout, sequence, phasing, system definition, etc.). (Beazley and Allan, 
1973b) With this assumption in mind, then the detection and measurement 
of design activities for research or educational purposes requires a communi- 
cation medium sensitive to these activities. The solution chosen is a graph- 
theoretic data structure represented to the subject as a directed graph. 



T 

Harary (1969) has advocated the use of directed graphs as a representation 
of the structure of a set of components in a network. These components can 
be anything from various parts of speech, options in a design, probabilities 
of certain events, individuals in a group, etc. In addition, there is a set 
of ordered pairs specified on those nodes which, together with the set of 
nodes, specifies the structure or topology of these nodes. In some kinds 
of problems one can specify weightings and/or attributes with both the 
nodes and the ordered pairs. In set theoretic notation, this is: 

A = Set of Nodes x 

B = Set of Ordered Pairs 

C = Set of Node Attributes 

D = Set of Ordered Pair Attributes 

B = {<X,Y > : (XeA) (Ye A)} 

C = { c: (ceC) (<c,x>eM) (X eA)} | 
D = { d: ,Je D) ( <d, < x,y» e N) ( <x,y > e B)} 

By no means is this way of communicating structure limited to that 
already described but the system discussed is constrained for practical 
reasons as described above. With ?ach node there is associated an attribute 
number, a parameter which defines what kind of option that node represents. 
Since it is possible to select an option more than one time for use, another 
number, a unique number, is associated with each node as it is chosen. 
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The set of ordered pairs specified on the set of nodes can be represented 

i 

In matrix form as an adjacency matrix. It is specified as follows: 

a.j = 0 IF (< i, j > B) 
a^j = 1 IF (< i, j > e B) . 

The adjacency matrix is constructed according to the unique number. 
Thus the system Is capable of creating the adjacency matrix of any network 
of nodes of any attribute to any degree of redundancy within the hardware 
space limitations of the host NOVA-IMLAC system. 

For a more detailed discussion of the properties of adjacency matrices, 
see Harary (1969) . 

In the classroom, application difficulties arise with respect to available 
technology for use. pidagoglcally, it is not only desirable to record the 
directed graph create! by the student, but also to compare it to a desired 
graph. Or, one might want to see if certain organizational rules are obeyed 
(rules established by theoretical or empirical considerations). It was 
decided that at the present level of understanding of design behavior it would 
be counter-productive to attempt to specify lawful relationships among the 
various nodes. Instead, classroom tutorials are based on the learning of 
Instructor-created diagraphs. This requires an algorithm that can compare 
a student-'dreated digraph with the Instructor-created digraph and determine 
whether they are the same. 

Again, the pedagogical approach of using directed graphs benefits 
directly from existing technology. A student-created graph will be 

ii 
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structurally the same as the instructor-created graph if they are isomorphic. 
This presents an immediate problem in the case where nodes are redundant 
with respect to attributes. It may not be possible to quickly distinguish 
between nodes which have the same attributes and simHar or identical 
Interconnections with other nodes of the grSph. 

The decision was made to delimit instructor-created digraphs to digraphs 
without attribute redundancy. The comparison routine became a simple 
matter of ordering the student-created matrix according to the arrange- 
ment of attributes of the instructor-created matrix and performing a 
subtraction. Execution time on the NOVA-IMLAC system for the directed 
graph of 15 nodes is less than 2 seconds in the single-user case, an 
entirely acceptable delay for this complex application . In addition, 
the remainder of the matrix subtraction furnishes v^aluable information 
about the closeness of the student attempt to create the desired graph. 
The zero result indicates equivalence; the non-zero result gives information 
about presence of unwanted connections and the absence of desired connec- 
tions. This can serve as feedback to the student and data for evaluation. 

In the ways described above, the designer, student, and experimental 
subject can be measured in an accurate, controllable way for research and 
pedagogical purposes. Subject to certain constraints, a digraph can be 
compared to a target digraph, allowing for the use of tutorial tasks for 
teaching subject matter or for studying patterns of learning. 
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Representing the Directed Graph to the Creating Individual . 

Any directed graph, can be specified by the set of nodes and the set of 
ordered pairs of first and last points. Displaying this to the individual 
using the graphical system is an ifnporlaht consideration, as these repre- 
sentations to the designer or student can influence, bias, or otherwise 
distort his behavior in the task. Here, the graphical representation of the 
directed graph will be discussed in detail, and discussion of the possible 
ergonomic factors involved in the design of the display will await results of 
research now in progress. 

In discussing the display of the graph to the subject, consider the 
subject confronting the blank display. (Figure 1 ) 

Creation of the digraph, how it is edited, and the appearance of the feedback 
information during a learning task will be discussed. 

In its present form, the set of options, etc. , are displayed at the right 
of the IMU\C graphics screen as a menu of verbal phrases inside of circles 
or squares (light buttons) . Each of these phrases is sensitized for the 
lightpen. At the bottom of the screen are additional one-word comments like, 
"END," "LINK," and "DELETE." These are commands used for creating, 
editing, and requesting checks on the directed graphs. To create a graph, 
the tracking cross is positioned on the screen and the desired option chosen 
with the lightpen. Then the chosen option appears on the screen at the 
location of the cross. (Figure 2) 
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When an appropriate number (at least two) of options are assembled 
on the screen, the subject can link the options in a desired way by using 
the lightjjen to select the "LINK" instruction at the base of the screen. 
Then the Subject. indicates the first and last nodes with the lightpen 
and an arrow appears on the screen confirming his choice. (Figures 3) 
Should it be desired to edit the graph, the subject merely hits the 
Instruction marked "DELETE" and hits the node or line to be removed. 

V ■ ' 
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The connection or node disappears and, in the case of a node, all connections 
to it disappear a\s'6. 

During this creation and editing of the pictorial representation of 
the directed graph on the graphics interface, the NOVA/BASIC main 
program accounts for the additions and deletions of nodes and connections 
by updating the adjacency matrix that corresponds to the graph. At 
the end of a creation session the subject hits a lightbutton labeled "END" 
and the adjacency matrix is copied on a file along with important secondary 
information (like location on the screen, special names used for referencing 
nodes and connections in the \MIAC terminal) . At this point, the main 
program can chain to any other desired routine. (Figure 4K 

in the situation where the routines are being used for subject training 
In a learning task, the next routine. in the chain is the one that compares 
the subject-created graph to a predetermined response graph. A matrix 
is formed which represents an adjacency matrix of the difference between 
the created and desired matrices, and this is also copied on a file. 

This difference matrix is read by an interpretation-feedback subroutine 
which either indicates success, (solid connections) , blinks .erroneous connec- 
tions, and draws in missing ones as dotted connections. .This kind of spatial 
feedback is possible because of the capability of the system in detecting and 

f 

interpreting the created directed graphs. \ j 

The applications qf system features described so f^V are not specific 
to any particular discipline. Rather, they can be applied to the measurement 



of any behavior with identifiable aspects that are unique and a structure 
described by ordered pairs. Examples of such behavior include the specifi- 
cation of sentence structure according to a transformational grammar 
(Linguistics), specification of group structure (Social Psychology), specifi- 
cation of material flow (Operations Research), specification of managerial 
authority (Business Administration), and the specification of design ' 
information flow (Engineering Design) . The general nature of the approach 
and the widespread impact of its content-independent technology make the 
system described highly transferable at the conceptual level. 

(7 

The System Applied to Engineering Design Education . 

J - 

The system described so. far has been applied to design education In . 
engineering, linguistics education, and for research in man-machine 
communication, the essential theme of these'applications is the communi- 
cation of structure to a machine. The discussion that follows will focus 
on the application to engineering design education. 

The goal of the present effort is to measure performance of designers 
during ^the solution of real design problems. Such a measurement system 
requires that designers select from options available to them and specify 
a structure or structures among those options • Thus, engineering design 
involves choice from and.thp specifIcatior:i of relationships among options in 
the environment. This set of options is represented to the student as a 
menu. This menu is composed of possible parameters, activities, data, 

/ 
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and other information relevant to a particular problem. Although the 
repertoire of options is specified by the instructor for each instructional 
task, an expanded data base could make the number and types of'retriev- 
able options entirely arbitrary. A solution to an engineering problem 
presented to the student is embodied in the creation of the directed graph 
representing the systematic method of the intended solution. 

Thus, the education of the embryo designer involves two compbnents: 
the education of the student of thje options available in the environment and 
the training of the student in the use of tho^e options^ Figure 5 shows a 
student interacting with a CAI routine on the use of Mohr's Circle for 
finding the principal stresses associated with biaxial stress. This is an 
example of the 1st component of the learning process. The methoc} of 
Mohr's Circle is one of the options he will be required to use later in 
the stress analysis of designs under load. A set of questions about the 
method is answered by the graphical data entry of the stress states and 
the lightpen selection of different points around the circle. For each 
point selected,. the corresponding stress element is drawn by this tutorial.^ 
The student designer becomes acaquainted with the parameters, methods 
and other options available for use in engineering design. 

' The second aspect of the education of the designer, the training of 
the designer in strategies of problem solving, is more complex. 
Figure 6 shows a typical graph that the student would be asked to learn. 
It Indicates information flow in a solution to the following problem. 

19 
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"Given the loads on a beam, draw'the load, shear, and moment diagrams." 
Each arrow on the graph means "provides information for." It represents 
in schematic terms the structure of the problem-solving method the student 
will use for a particular problem. A written description of what is Occurring 
in the graph is: 

Take the loads on the beam and construct a load diagram. 

■I 

Also, take the loads and perform a static analysis on the beam. 
Integrate the load diagram to get the shear diagram, using a 
boundary condition given by the static analysis. ' Integrate 
the shear diagram to get the moment diagram, using a boundary 
condition from the static analysis. 

The student responds by creating the graph showing his solution to the 

problem. (Figure 7). 
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FIGURE 7 



Conclusion > 

This paper has discussed a program developed to detect and measure 
the communication of structure among known sets of options by the creation 
and editing of directing grapfts. It represents the joint application of graph 
theory both as an internal data structure in the computer and as a display 
to the operator. Digraphs are not the only structural relationship possible, 
but are applicable to a large class of problems in the laboratory and the 
classroom. Since the development of these routines, they have found 
application in engineering design education, linguistics education, 

I 

journalism education, and graph format for experimental investigations in 
man/machine communication. Evaluations of the approach are in progress 
In these areas. ' 
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